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Description 

FIELD OF THE INVENTION 

5 [0001] This invention relates to a method for reconstructing non-continuous packetized data of a continuous data 
stream like streamed media, voice, audio, or video from a data connection into a continuous data stream at the receiving 
point of a packet-based network as well as, an output unit, a terminal, and computer program products therefore. 

BACKGROUND OF THE INVENTION 

10 

[0002] Many sophisticated emerging applications, such as voice over IP, multimedia conferencing, or distributed 
virtual reality, are difficult to deploy in todays internetworking infrastructure. This is mainly due to one requirement that 
all these applications share the need for guaranteed real-time service. These applications not only require high band- 
width, but predictable quality of service (QoS) such as jitter delay as well. 
15 [0003] The QoS requirements at network level are typically specified in terms of bounds on worst-case end-to-end 
delay on the worst-case packet loss rate and on the worst-case delay jitter for packets of the connection. Other pa- 
rameters may be specified as well, such as deadline miss rate. The desired delivery time for each message across 
the network is bounded by a deadline, a specific maximum delivery delay. This delay bound is an application-layer, 
end-to-end timing constraint. 

20 [0004] If a message arrives after the deadline is expired, the message is useless and is typically discarded. For many 
real-time applications, it is not important how fast a message is delivered. Indeed, packets arriving early may need to 
be buffered at the receiver to achieve constant end-to-end delay. Therefore, delay jitter, which is the variation in delay 
experienced by packets in a single connection, is a critical performance metric. For example, in video transmission, 
jitter may cause some frames to arrive early, and others to arrive late. Although the transmission of all frames satisfies 

25 the deadline requirement, the displayed movie may appear jittery. Same applies to streamed audio data. 

[0005] Buffers at the receiver can be used to control delay jitter. The amount of buffer space required can be deter- 
mined from the peak rate and the delay jitter of the delivery process and can be quite large for a network with no control 
of delay. 

[0006] Important quality of services are especially delay jitter, delay, and packet loss. Delay jitter and packet loss 
30 obstructs proper reconstruction at the receiver whereas delay impairs interactivity. 

[0007] The following section contains definition for the notions of streams, packets, and channels. 

[0008] Streamed data is a data sequence that is transmitted and processed continuously. Streaming is the process 

of continuously appending data to a data stream. 

A packet is a piece of data consisting of a header and a payload information. Packetizing is the process of decomposing 
35 data into a set of (small) packets, where the header is used to store information for reconstruction, e.g. a sequence 
number. 

A data channel is a connection between two network units that is able to transport data. Delay is the time between 
sending and receiving a packet. Delay jitter is the variation in delay. Packet loss is an infinite delay. 
[0009] A common used technique for streamed data is to use a buffer at the receiver for reducing delay jitter and 
40 packet loss against an increased overall delay. Hence there is a demand for optimization. Especially real-time streamed 
data, like video or audio streams, needs to be on-line processed, i.e., with small delay and small jitter delay. 
[0010] A well known algorithm to solve this problem is to buffer streamed data and to replay the buffer at a constant 
speed to absorb delay variations and play-out packets at fixed deadline, called jitter absorption. Packets received after 
deadline are discarded. 

45 A more sophisticated algorithm is to monitor delay and/or delay variation and adapt play-out time accordingly, called 
jitter adaptation. An application might then slow down play-out when delay increases to avoid loss and speed up play- 
out when delay decreases to reduce delay. 

[0011] It is object of the invention to provide a method for reducing delay jitter, delay, and packet loss for streamed 
data connections. 

50 

SUMMARY OF THE INVENTION 

[0012] The present invention is a method for reconstructing non-continuous packetized data of a continuous data 
stream like streamed media, voice, audio, or video from a data connection into a continuous data stream at the receiving 
55 point of a packet-based network, comprising the steps of 

providing of at least one estimation method based on at least one characteristic value concerning data connections 
of the kind intended for, 



2 



EP 1 349 342 A1 



gathering measurements of at least one value characterizing the data connection, 

evaluating a de-jittering delay for the data connection by predicted parameters taking into account the at least one 
provided value and the at least one gathered value, 

delaying and converting the data packets following the evaluated de-jittering delay. 
5 The invention also relates to an output unit, a terminal, and computer program products for a terminal and for an 

output unit. 

[0013] The essential idea of the invention is iterative gathering network observations for a statistical prediction of 
network behavior, and adapting iterative said converting method according to said prediction. 
10 The present invention uses a continuous optimization for adapting the parameters of a conversion method. This opti- 
mization decomposes into three steps. Continuously gathering network observations, i.e. quality of service measure- 
ments, deriving a statistical prediction from these network observations, and adapting the parameters of the conversion 
method according to said prediction. 



15 BRIEF DESCRIPTION OF THE DRAWINGS 



[0014] 



Figure 1 . shows a network, terminals, an output unit, and the context of streamed data reconstruction according 
20 to the invention. 

Figure 2. shows the phases of reconstructing streamed data out of a packet stream according to the invention. 
Figure 3. shows a use case diagram according to the UML notation describing the boundaries of the method for 
streamed data reconstruction according to the invention. 

Figure 4. shows a class diagram according to the UML notation describing an architecture of computer program 
25 for streamed data reconstruction according to the invention. 

Figure 5. shows a computer program for streamed data reconstruction according to the invention. 

Figure 6. shows an "Estimation" class for a computer program for streamed data reconstruction according to the 

invention. 

Figure 7. shows a timeline of a encoding - transportation - decoding delay scenario. 



30 



DETAILED DESCRIPTION OF THE INVENTION 



[0015] Figure 1 shows of a network B1 two data channels B2, an output unit B3, and two terminals, a computer 
terminal B4 and a telephone terminal B5. 
35 The terminal B4 has an output unit B3. This output unit B3 is connected via a data channel B2 with a network B1 . The 
telephone terminal B5 is as well connected with the network B1 via a data channel B2. 

[0016] The figure describes the scenario for this realization. Both terminals B4, B5, in the role of a receiver, are 
connected with the network B1 via data channels B2. The terminals receive packets over the data channels and these 
packets contain streamed data, which has to be reconstructed. To be able to reconstruct the data stream, there might 
40 be a special hardware, called output unit B3, that alternatively might be integrated in the terminal. The terminal and 
the output unit are assumed to be controlled by a computer program. Although the realization of the reconstruction 
method could also be implemented in software only. 

[0017] Figure 2. shows a control entity A1 , a buffer queue A2, an input channel A3, an output stream A4, an input 
packet sequence A5, an output data stream A6 and an illustration of two time intervals A7 between two consecutive 

45 packets also known as packet inter-arrival times. The control entity A1 controls the buffer queue A2, i.e. when the 
queue has to be emptied and filled. The buffer queue A2 is connected with the input channel A3 transporting the input 
packet sequence A5. The input packet sequence A5 consists of a sequence of packets A5, where each packet having 
a packet sequence number 1 5,16, ...,20. This input packet sequence A5 needs not coinciding with the packet number 
sequence as illustrated in the drawing. The figure does not show the packet representation, i.e. header, payload, etc. 

50 it is assumed that the payload is already extracted and labeled by the sequence number. The figure shows especially 
the time intervals A7 between the consecutive packets 19 and 20 as well as the time intervals A7 between the con- 
secutive packets 1 5 and 1 6. The buffer queue A2 is also connected with the output stream A4 transporting the ordered 
continuous output data stream A6. The output stream is ordered by packet numbers and the time interval between two 
consecutive packets disappears, by using the previously buffered reservoir. 

55 in the illustrated configuration the output stream data carries data from packets 1 ,2,3,4,5, the buffer queue A2 stores 
packets 6, 7, 8, 9, 10, 11, 12, 13, and the input channel data A5 consists of the packets 15, 14, 16, 17, 19, 18, 20. 
[0018] The figure illustrates the functionality of reconstructing a data stream. A jittered input data stream running into 
a buffer, converted into a continuous output data stream. The arriving packets, each having its number, are translated 
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into an ordered continuous data stream where the data is ordered by the packet numbers and the time interval between 
the content of two consecutive packets disappears. In the example it is assumed that the packet stream has a jitter 
and the packets need not arrive in the origin sequence. 

The network might have additional characteristics, e.g. an asserted delay bound that should be taken into account 
5 when implementing the described functionality. In further, it is assumed that there is no packet loss. In case of packet 
loss additional strategies have to be considered beside buffering, e.g., reconstruction of packet information on the 
application layer or depending if network resources and time are available an additional request for re-transmission. 
[0019] Figure 3. shows a use case diagram according to the UML notation, from the 'Unified Modeling Language 
User Guide', G. Booch, J. Rumbaugh, I. Jacobson, Addison-Wesley, Reading MA, 1999, pages 233 - 236, containing 
10 the actors "Network" and "Application", as well as a use case "Converter" and a use case "Control". 

The "Network" is associated with the "Converter" by "Data channel" and the "Application" is associated with the "Con- 
verter" by "Data stream". The "Converter" is extended by the "Control". 

[0020] The diagram shows the problem context, namely the data channel "Data channel" supporting the jittered 
packet data stream shown in Figure 2, and a application "Application" requesting the reconstructed continuous 
'5 streamed data. This reconstruction is performed by a controlled converter "Converter" extended by "Control". The 
control mechanism is explicitly stated. It might be hidden by other use cases as side effects, e.g. a scheduler integrated 
in an operating system. 

[0021] Figure 4. shows a class diagram according to the UML Notation, from the 'Unified Modeling Language User 
Guide 1 , G. Booch, J. Rumbaugh, I. Jacobson, Addison-Wesley, Reading MA, 1999, pages 105 - 108, containing the 
20 data types "Channel", "Stream", and "PriorityQueue"; the processes "Receive" and "Stream"; and a class "Estimation". 
"Channel" provides the two methods "End" and "Fetch". "Stream" provides the two methods "Append" and "Read". 
"PriorityQueue" provides four methods "Add", "Get", "IsEmpty", and "Size". "Estimation" provides the two methods 
"Measure" and "Predict". 

The diagram shows an architecture for streamed data reconstruction. This architecture has a framework character. It 
25 is designed for illustration purposes. It allows to substitute the estimation and to simplify the description by abstraction. 
An architecture of a realization is influenced by the complete product design. 

The architecture consists of three abstract data types, a channel, a stream and a priority queue, as well as two proc- 
esses, "Receive" and "Stream". 

The priority queue is chosen to illustrate the abstract buffering mechanism. It is not necessary to use abstract data 
30 types. For instance, a often used technique instead of a priority queue is a straight forward array implementation of a 
buffer queue. 

[0022] The processes need not to be explicitly designed. Instead one might realize the method by threads or operating 
system services. 

[0023] The data type "Channel" is aggregated by the process "Receive". The data type "Stream" is aggregated by 
35 the process "Stream". The data type "PriorityQueue" and the class "Estimation" are both associated to both processes 
"Receive" and "Stream". 

[0024] The method "End" of the data type "Channel" returns the Boolean true when the last packet of the packet 

sequence has arrived, the Boolean false otherwise. The method "Fetch" returns the next received packet. 

The method "Append" of the data type "Stream" appends the argument to the end of this stream. The method "Read" 

40 reads the head of this stream (destructive). 

The method "Add" of the data type "PriorityQueue" enters the argument into this priority queue. 
The method "Get" returns the least element of this priority queue. The method "isEmpty" returns the Boolean true if 
this priority queue contains no element, the Boolean false otherwise. The method "Size" returns the number of elements 
contained in this priority queue. 

45 The method "Measure" of the class "Estimation" collects network performance information and updates network char- 
acteristics accordingly. The method "Predict" returns values for controlling the behavior of the two processes. 
The two processes are controlled by the class "Estimation" that measures network behavior and derives network per- 
formance predictions. The two processes "Receive" and "Stream" use this prediction in order to adapt their behavior, 
e.g. the use of the buffer queue or the stream speed etc. 

50 [0025] Figure 5. shows a program implementing the architecture for streamed data reconstruction of Figure 4. 

The abstract notation for the program consists of a declaration part for variables and types, labeled by 'DECLARATION' 
and an implementation part labeled by 'IMPLEMENTATION'. The variable declaration part consists of three objects: 

"Input", a "Channel", 
55 "Output", a "Stream", and 

"Buffer", a "PriorityQueue". 

[0026] The type declaration part consists of three data types: 
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- a data type "Channel", framed by 'DATA TYPE Channel' and 'END DATA TYPE Channel 1 , 
a data type "Stream", framed by 'DATA TYPE Stream' and 'END DATA TYPE Stream', 
a data type "Priority Queue", framed by 'DATA TYPE PriorityQueue' and 'END DATA TYPE PriorityQueue'. 

5 The implementation part consists of 

a process "Receive", framed by 'PROCESS Receive' and 'END PROCESS Receive', and 
a process "Stream" framed by 'PROCESS Stream' and 'END PROCESS Stream', 
a class "Estimation", framed by 'CLASS Estimation' and 'END CLASS Estimation'. 

10 

[0027] The data type "Channel" consists of 

a method "End", returning the Boolean true if the input packet sequence ends, and 
a method "Fetch", returning the next arrived packet. 

15 

The data type Stream has also two methods: 

a method "Append", adding a data element at the end of this stream, and 
a method "Read", returning the next element of the stream. 

20 

The data type "PriorityQueue" has four methods: 

a method "Add", adding a packet to this priority queue 

a method "Get", returning and removing the packet with the least element, i.e. the packet with the least number, 
25 from this priority queue, 

a method "IsEmpty", returning the Boolean true if the priority queue contains no packet, 

a method "Size", returning an integer, the number of packets contained in this priority queue. 

[0028] The process "Receive" consists of a loop, framed by 'WHILE' and 'END WHILE', with the terminating condition 
30 'NOT Input. End()', and a body consisting of the statement sequence 'packet = Input. Fetch()'; 'Estimation. Measure 
(packet)' ;'Buffer.Add(packet)\ 

Hence, the process iterative reads a packet from the input channel, update the performance statistic of the network 
and buffers the packet, until the last packet is arrived. 

[0029] The process "Stream" consists of a main loop, framed by 'WHILE' and 'END WHILE', with the terminating 
35 condition 'NOT (lnput.End() AND Buffer. is Empty())' and a body consisting of the statement 'Estimation. Predict(Buffer- 
Size, DelayTime)' followed by a sequence of further while loops. 

[0030] The first while loop, framed by 'WHILE' and 'WAIT END WHILE' has the terminating condition 'Buffer.SizeQ 
<BufferSize' waits until the buffer is filled according to the predicted value Buffer.Size. 

The second while loop, framed by 'WHILE' and 'END WHILE', with the terminating condition 'NOT Buffer.isEmpty()' 
40 and a body consisting of the statement sequence 'Output.Append(Buffer.Get())'; 'DELAY(DelayTime)', empties the 
buffer and serves the stream continuously with a homogenous by the Estimation predicted delay. 
The latter two loops are iterated until the complete stream is reconstructed. 

[0031] The kernel of the described program and the control of the processes and the buffer is the class "Estimation". 
This class contains the variable "meanDelay". In general this class contains variables for measured network charac- 
^5 teristics. 

Furthermore, the class "Estimation" consists of a set of variables for the statistical observations and two methods, 

a method "Measure" that updates the network characteristics by observed events, here a packet arrival, and 
a method "Predict", that returns parameters for the conversion, here BufferSize and DelayTime, based on gathered 
50 network characteristics. 

It should be noted that the methods of the two processes are only a specific option model. Beside the stated mode 
there might be a streaming handshake, forcing faster streams, or an application that might allow a homogenous delay 
or a smooth increasing delay. 

55 [0032] Figure 6. shows a program implementing a class Estimation introduced in Figure 5. The class "Estimation" 
is framed by 'CLASS Estimation' and 'END CLASS Estimation' and contains five variables, three reals "T", "sr", and 
"tr", as well as two integers "R" and "n", and two methods. 
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A method "Measure" that updates the mean delay T by an observed packet delay t, as well as the decrement of 
the number of remaining packets R and 

A method "Predict", that returns parameters for the conversion, buffer size B and delay time (the reciprocal of the 
sample rate), based on gathered network characteristics. 

5 

[0033] Figure 7. shows three diagrams, labeled by 01 , 02, and 03. The x-axis of each diagram is the time and the 
Y-axis are packets. Diagram 01 shows encoding and packetisation, diagram 02 shows transportation through a net- 
work, and diagram 03 shows the stream resuming at the receiver. The figure depicts an encoding - transmission - 
decoding scenario. There are three observation points 01 at the sender, 02 at the network, and 03 at the receiver. 
10 Diagram 01 consists of a packet Ppj) and two occurrences of packet P(2,i). Diagram 02 consists of a waiting packet 
W (2,1) and total service time intervals N stag 7" s for each packet Diagram 03 consists of a de-jittering delay Tj it and 
a decoding delay T dec . 

The diagrams are connected via three dashed arrows showing a path of packet P(2,i)- 

The horizontal double arrows A 2 shows a time interval until packet P (2t i) arrives The horizontal arrow W 21 shows a 
15 waiting time interval of packet P(2,iy A horizontal arrow N stag T s shows a service time interval of P(2 t i)> and a horizontal 

arrow d 2 1 shows a delay of packet P (2 ^. Assumptions for the shown scenario are identical encoding (e.g. Voice Activity 

Detection or not) and packetisation of the arriving calls, with no time stamps and available packet sequence numbers. 

Negative-exponentially distributed connection inter-arrival time A 2 is assumed at the encoder. 

Shown in diagram 02 a packet-based network delays discontinuously packets with a deterministic service time N stag T s , 
20 No priorities, no re-transmission, no overtaking, no change in routing, only real-time traffic, and no disturbing data 

traffic is assumed. 

The packet P (21) is traced through the described scenario. At the sender this packet is created after the time A 2 starting 
from the creation event of the preceding packet Pf^y When the first packet is processed the packet P (21 ^ enters the 
network. There it waits for the time W 21 . When the waiting time is passed the network transports the packet within 

25 time T s \o the receiver. At the receiver it is buffered for a time 7} /Y and decoded within a time T dec . 

[0034] The following section contains an example application for a stream transmission scenario where a size of a 
file to stream is known and a network that delays equally sized packets equally. Then considering the following inter- 
mediate scenario enabling one to determine the optimal buffer size for continuos streaming, i.e., the following three 
events coincide: buffer is empty, the file is completely transmitted, and the buffer is completely streamed. Because of 

30 the deterministic delay assumption there is no need for prediction. But the example shows the dependence of the 
scenario parameters and illustrates the adaptive buffer functionality. In an intermediate scenario there is a rest of the 
stream to transmit at the sender, called rest, of size R, a buffered stream, called buffer, of size B and a played stream 
at the sender. The above three events coincide when the transmission time for the rest and the time for streaming the 
rest and buffer is equal. The transmission rate tr is 1/T, the stream rate is a constant, say sr. Then the transmission 

35 time for the rest is Rltr and the time for streaming the rest and buffer is (R+B)lsr. Derived from the equation R/tr = 
(R+B)/sr one concludes the optimal buffer size B = srftr* R - R. 

For most packet networks the assumption that each packet is delayed equally is wrong. But one could approximate 
the real delay with the mean delay of the already transmitted packets instead. The mean delay T(n) for n transmitted 
packets each having its own delay f, is the sum delay t 1 + t 2 + ... + t n divided by n. For calculation T(n+1) consider T 
40 ^7;=^+^...+^^ but (t^..M n ) = n * T(n). Hence T(n+1) = (n * T(n) + t n+1 ) 

/(n+1). 

The above discussion is illustrated as an implementation of class 'Estimation' shown in Figure 6. 
The statistical model can be enhanced by observable properties of the network like packet routing, traffic, or network 
topology, and of the stream content itself, like length pauses and talk spurts in the case of voice data streams, as well 
45 as past transmissions or even past connections. 

The following section describes a more complex application for the special case of reducing delay jitter for a packetized 
voice network, with minimal delay, i.e., small queues in the context and with the assumptions of Figure 6. A set of 
recursive measurement and prediction equations, based on multiple probabilistic models is developed illustrating the 
claimed method. 

so The main assumptions are a constant inter-arrival time for the packets at the network during active voice, but no 
constant inter-departure time when arriving at the receiver. 

[0035] For this application additionally a probability function which describes the network packet delay behaviour is 
missing. The delay of the first arriving packet (reference packet) c/ re /is unknown, as well as the sender clock is unknown 
and the time stamps are unavailable. The application has the property to be able re-configuring the queue while silence 
55 phases. Hence this application is an example for a tight coupling of the application layer consuming the transmitted 
stream. 

For the detailed description the following notations are used for the encoding and packetisation delay factors 
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frame size 7> 

encoder processing time T enc 
look ahead T LA 
A/ F code words per packet 
inter-packet time N F T F 
decoder processing delay T dec 

and for the network delay factors 

inter-packet time N F T F 
service time per node and packet T s 
number of traversed nodes N stag 
total service time N stag T s 
statistical waiting time W N 

[0036] For the end-to-end delay we say the delay introduced by encoder, packetizer and decoder: T encPdec = 
N F Tp+ TLA+Tenc+Tfec, for the delay in the packet-based network: D = N stag T s + W N , and for the dejittering delay: T Jit 
[0037] The initial values for the statistical model are 

the maximum end-to-end delay is d E2 E> 
the number of traversed nodes N stag , 
the service time per node T s , 

the mean number of created packets per call is x calculated out of the mean call holding time 
calls per second (dependent on daytime) 
packet frame length T F 
number of packets per frame N F 

The assumed/pre-defined statistical values are 

Number of overall competing connections N iP 

Number of route busy periods M 

Number of competing connections per busy period n m 

[0038] The following section contains notations used for the described packet delay calculations, ^m^nt of packets 
from calls arriving after the observed connection / until network arrival instant of packet number r. x r . 
[0039] Number of additional packet arrivals of previous connections between / h connection arrivaViftsfent and net- 
work arrival instant of packet rfrom connection / : x k . Probability of j Poisson arrivals during packet producing time 
interval of a single connection: m 



a(r-1)N F T F ) J . X ir.1)N F T F 

v= — j — e 



[0040] The following section contains an itemization of the used notations for mean delay calculations 



Mean delay of an arbitrary packet: d(N stagt T Sf x,X,N F T F ) 

Mean absolute relative delay of an arbitrary packet: AdiN^^T^x^NpTp) 

Mean delay of the /* h packet d ^N^^T^x ,X,N F T F ) 

Average number of cumulative network packet arrivals at network arrival instant of packet number r. 




and of an arbitrary packet: 
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q(x,N JP ,x min ,x mittW ). 

Average relative number of cumulative network packet arrivals at network arrival instant of packet number r. 
and of an arbitrary packet: 

Average minimum amount of additional packets from previous connections at network arrival time instant of packet 
number r. 

~x^$,X,N F T F ) 

and of an arbitrary packet: 

Average minimum amount of additional packets from calls arriving after the observed connection until network 
arrival instant of packet number r. 

xf^(x,Z,N F T F ) 

and an arbitrary network packet arrival instant: 

Mean total inter-arrival time of an arbitrary packet: 

: l{A,x,N,T F ), 

the fl> call: 



I„(A,x 9 N if T F ) l 



and the I th packet: 
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5 - Mean value of N IP Erlang-(/-1 ) distributed time intervals: Y(X) 

Mean values of the relative absolute total inter-arrival time of an arbitrary packet: 

a7(/U,A^,7>), 

10 

the I th call: 

and the I th packet: 

20 

[0041] The following list contains the set of values for initialisation and adaptation. 

25 

Packet arrival instants at the decoder: t Dr 
Delay of the /* h packet: d r 

Reference packet number ref, which is the number of the first arriving packet 

QoS dejittering delay: T Jit 
30 - Packet loss probability: P hss 

Maximum allowed end-to-end delay: d E2E 

Number of packets per active voice period x^j 

Number of packet losses x /oss 

Number of overlong delays x E2E 
35 - Coefficient of variation c 

Hypo-exponential Process F D (t,t 1t t 2 ) with mean values f-, and f 2 . 

Hyper-exponential Process F D (t,p,t^,t 2 ) witn tne mean values f 1>2 and probability p. 

[0042] We have two qualities of service bounds, the packet loss restriction Pr L d> d mjn + T Jit J< P foss , and the delay 

40 restriction d max + T jn < d^. 

[0043] The problem of serving continuous streamed voice data is solved by gathering the decoder packet arrival 
instants t Dref and t Dr ; then approximating the delay of the first arriving packet d ref with a pre-calculated mean delay 
value and calculating the delay of the /* h packet out of d r = t Dr - t Dfef + d - (r- ref)-N F T F , and creating a substitute delay 
probability function to calculate the maximum tolerated packet delay and consequently the dejittering delay. Packets 

45 missing the quality of service restrictions for packet loss d r < t D -t Dref +d-{r-ref)-N F T F , or equivalent^ t Df <t Dref + T yVY + (r- 
ref)-N F T F anti the end-to-end delay d r + T Jjt < d^are discarded. 

[0044] The following section contains the variables needed for packet delay calculations. The delay of the /* h packet 
produced from the connection during busy period m is denoted as d^,. 
[0045] W km+ i tf . denotes the waiting time of packet number k m + i,r. 
so / M describes the total inter-arrival period from the begin of route busy period m until network arrival instant of the /* h 
packet of the 7 th connection. 

The total number of network packet arrivals ffflfl^tjie beginning of the busy period m until service beginning of the 
observed packet is named % m+ ij= M+r-1 4- + x +x R . Y M is the Erlang distributed time interval of /-1 negative- 
exponentially distributed successive call inter-arrtval time^intervals. 
55 A/ M r denotes the relative total inter-arrival time of the /* h packet produced from the / h call. The negative-exponentially 
distributed encoder inter-arrival time of the I th connection is named A km+i . 

[0046] The following section contains a description sample jitter delay algorithm for voice data streams. 

This prediction is based on gathered the decoder packet arrival instants t Dref and t D ^ via an approximated delay of the 
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10 



15 



20 



25 



30 



40 



first arriving packet d ref with a pre-calcuJated mean delay value and calculate the delay of the /* h packet out of cf r = t Dr 
- t Dfef + d -(r-ref) • N F T F ; and a substitute delay probability function to calculate the maximum tolerated packet delay 
and consequently the dejittering delay. 

There are two quality of service bounds considered, namely, the packet loss restriction Pr L d > d mm + T jjt } < P hss and 
the delay restriction of max + Tj it < c/ SE . 

[0047] The "Measure" method for this example initializes the statistic observations by gathering the following values 
during call set-up 

the maximum end-to-end delay £/ E f 

the highest tolerated probability for packet loss due to jitter problems P loss 
the number of traversed nodes N stag 
the service time per node T s 

the mean number of created packets per call x calculated out of the mean call holding time 
calls per second (dependent on daytime) 
packet frame length T F 
number of packets per frame A/ F for 
the (initial) service time N stag T s 

the packet length N F T F 

the initial mean delay of an arbitrary packet c/ 0) := d(N stagt T $> xJ^J F T F ) 
the initial mean absolute relative dela^Jjan arbitrary packet Ac/ } := Ad(N stag ,T s ,x,X,N F T F ) 
the initial coefficient of variation c<°) - A to determine the initial delay probability function. 

J® 

[0048] While the call is_active the "Measure" method gathers the packet arrival instants t Dr . Then the delay of the r* h 
packet by d r = t Dr -t Dfef +cf o) -(r-ref) -N F T F '\s calculated. The quality of service restriction for streamed voice data are for 
packet loss requirement t Dr < t Dref + (r- ref)N F T F and for delay requirement d r + 7^ < d B2 E- 
For the shown statistical description i/ is necessary to count the number packets per ac/tive voice period x ka&h packet 
losses x loss , and overlong delays x E £. 

The route length N stag and the service time N stag T s as well as the mean delay 



35 and the mean value of the relative absolute delay 



A</<«> := A</<*-'> + -J-'£|/^ +<r - W/ - {r - ref)NFTl \ , 



lq) 

and the coefficient of variation c<<?) = — — is updated during a talk spurt. 

[0049] In "Prediction" method oae ©&fculate cf q) choosmg the Hypo-exponential probability F D (t,t q \ f q) function 
when 0 £ d$ < 1 , where tf^ = cf q • (1-cM) ancfi^ = cf q • cto). And calculate cf q) from probability function with 
45 respect to packet loss probability out of </"> =F-l D fl 

" p ioss> >^ >t?^' If dti > 1 choose the Hyper-exponential prob- 



ability function F D (t } pfa),f^, where 



50 



M,2 



l±. 



'( c «; + i 



55 and p^> = . Calculate the maximum relative delay cf q) out of the Hyper-exponential probability density func- 

tion with e.g. the decomposition method. max 

The result is used to adapt the stream output respectively by the maximum relative delay: Acf q ^ := cf q ^ - d min = cf q) 



' N stag T s and determine T^ q) according to Acf q) =:7^ } < d E2E -cf q) during a silence period 



jit 



jit 
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[0050] The delay of the I th packet of the /* h connection during busy period m is the sum of its service time and its 
waiting time in the network: d km+ir = N stag T s +W kfni . lr 

The waiting time summarises the complete busy period until packet number k m + /,. starts being serviced and reduces 
it with the time interval / M y W km+Ir = N siag T s 'q krrT ± }r -l iAr / M r starts at the beginning of the busy period until the !* h 
packet network arrival instant: l hi r = Y jA + (r -1 )N F t F , where y M denotes an Erlang distributed time interval. 
[0051] The total number of network packet arrivals from the begin of the busy period m until service begin of the 
observed packet is q km +j tr 

The total inter-arrival time of the t* h packet of the / h call is / M r = V M + (r-1 )N F T F 
The relative total arrival time of the Vpacket of the / h call is A/ M if = (rA)N F T F 

The number of /= 1, ...,/and/=1, ... competing packet arrivals between fl* connection arrival instant and network arrival 
instant of packet rfrom connection / is 



15 



mini p..) 



V,. 



N,T, 



20 [0052] The number of additional packet arrivals of previous connections between /* h connection arrival instant and 
network arrival instant of packet rfrom connection /(/= 2, i) is 



25 



n+J" 











+ r-lj 





[0053] The amount of additional packets from calls arriving after the observed connection / until network arrival instant 
30 of packet number ris 



35 



40 



Number of additional packet arrivals of previous connections between /* h connection arrival instant and network arrival 
instant of packet rfrom connection i is 



min _ V" 1 min 

y=2 



45 The Erlang distributed time interval 



50 



55 



is calculated by composition technique out of A1 negative-exponentially distributed successive inter-arrival time inter- 
vals by generating U 1} U 2 > .... U iA (mutually) independent and uniformly distributed between Oand 1, Y^(X) = 1 -In 

{UyU 2 -U„). 

[0054] p y - r is the probability ofy'Poisson arrivals during packet producing time interval (r-1 )A/ F 7 F of connection /, hence 

(X,(f- 1)A/ F T F ) y -X(r-1)A/ F 7> 
Pj.r- T\ G F 
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[0055] The mean delay of an arbitrary packet is 



[0056] The mean delay of the r* h packet is d r = N stag T s _ + w r = N staQ T s + N stag Tsj_q r -J r 
The mean absolute relative delay of an arbitrary packet Ad = Aw = \N stag T s • x • Aq - A/I. 

[0057] The mean delay of an arbitrary packet is the average over all N fP packet delays observed during m= 1, 
10 M busy periods: 

75 



20 



= Vs + K ag T s -l±q r -lil r 



= V s + w = v. + V. • (* - i + <?)- / 



[0058] The mean delay of the r* h packet is the average over all 

30 



35 

packet delays observed during m= 1, Mbusy periods 

i K4 n m 1 M n m 



1 M n m I Mn^ 



45 ^V y/ , 

= N sta J s +^ r =N stag T s +N stag T s .f r -T r 

so [0059] The mean absolute relative delay of an arbitrary packet is the average over all x • N IP relative absolute packet 
delays observed during m= 1, .... Mbusy periods is given by 



55 
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Ac? - zir Z Z Z - d K*K 



* M n,„ 



1 ^— r 1 A- 



1 1A- 



10 



= Aw = \N sia T s .x-Aq-Al\ 



[0060] Average number of cumulative network packet arrivals at network arrival instant of packet number r is q r = r- 
1+1/2(/V /P -1)+x mm * Pr) " and for arbitrary network packet arrival instants 



15 



5) 



q = 1/2(5-1 )+1/2(A/ /P - 1) + x mln +x m,n(p ' 



Average relative number of cumulative network packet arrivals at network arrival instant of packet number r is Aq r = 
r-1 + x mln(Pr> " and at arbitrary packet arrival instants 



20 



25 



X 



&c] = -=r— \q-q x = 



X X 



2 x-1 



[0061 ] Average minimum amount of additional packets from previous connections at network arrival instant of packet 
number ris 



30 



=1 M 



35 and of an arbitrary packet 



* min = i/*2>, min 



40 



[0062] Average amount of additional packets from calls arriving after the observed connection / until network arrival 
instant of packet number ris 



45 



M n m 



=1 i=\ 



50 and an arbitrary network packet arrival instant 



i/*Z< 



55 



[0063] Mean total inter-arrival time of an arbitrary packet is 



13 



EP 1 349 342 A1 



5 

and for the /* h call: 



'0 

X riii \ 



and for the /* packet: 



75 



20 



[0064] Mean value of the relative absolute total inter-arrival time of an arbitrary packet: 

25 



(\ 1 M ] x y 

x, x , n )=— S£a/ h = r-rl>' =A ^-f 



3D and the / h call: 

35 

and the /* packet: 



A/,., (A, iV,T, )= =r- - £ A/, ,, = /V,T,. £ = A/ 



40 i a/ n m 

A/ r (A, N ,/Tp ) = — EE A/.-,, = (r - 1) . 

™/y> m=l i=l 



45 

[0065] The mean value of A/ /P Erlang-(/-1 ) distributed time intervals is given by 



50 



55 



iV IP i=J 



[0066] The Hypo-exponential Process is here used to construct a substitute probability distribution function and con- 
sists of a discrete time process D with random variable T A and mean t, = d-(1-c) linked with a negative exponential 
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10 



process M with random variable T 2 and mean t 2 = d c 

_f 0 for 0<t<t { 

[0067] The probability distribution function of the Hyper-exponential Process is used to construct a substitute prob- 
ability distribution function and is given by 

-(t/L) -(//tp) 

F D (t i p ^ t v t 2 ) = ^ -p-e -(1 -p)-e 



with the mean values 

15 



d 

20 and probability p = — . 



'l,2=*' 



Claims 

25 1 . Method for reconstructing non-continuous packetized data of a continuous data stream (A5) like streamed media, 
voice, audio, or video from a data connection into a continuous data stream (A6) at the receiving point (B3, B4, 
B5) of a packet-based network (B1), comprising the steps of 

providing of at least one estimation method (Figure 4: "Estimation") based on at least one characteristic value 
30 (Figure 5,6: "Estimation") concerning data connections (A3, B2) of the kind intended for, 

gathering measurements of at least one value (Figure 5,6: "Estimation") characterizing the data connection, 
evaluating a de-jittering delay for the data connection by predicted parameters (Figure 5,6: "Estimation") taking 
into account the at least one provided value and the at least one gathered value, 

delaying and converting the data packets following the evaluated de-jittering delay (Figure 3, 4; Figure 5: 
35 "Estimation", "Stream", "Receive"). 

2. Output unit (B3) for reconstructing non-continuous packetized data (A5) of a continuous data stream like streamed 
media, voice, audio, or video into a continuous data stream (A6), comprising means for 

40 - providing of at least one estimation method (Figure 4: "Estimation") based on at least one characteristic value 

(Figure 5,6: "Estimation") concerning data connections (A3, B2) of the kind intended for, 
gathering measurements of at least one value (Figure 5,6: "Estimation") characterizing the data connection, 
evaluating a de-jittering delay for the data connection by predicted parameters (Figure 5,6: "Estimation") taking 
into account the at least one provided value and the at least one gathered value, 

45 - delaying and converting the data packets following the evaluated de-jittering delay (Figure 3, 4; Figure 5: 

"Estimation", "Stream", "Receive"). 

3. Terminal with output unit for reconstructing non-continuous packetized data of a continuous data stream like 
streamed media, voice, audio, or video) into a continuous packet data stream, comprising means for 

50 

providing of at least one estimation method (Figure 4: "Estimation") based on at least one characteristic value 
(Figure 5,6: "Estimation") concerning data connections (A3, B2) of the kind intended for, 
gathering measurements of at least one value (Figure 5,6: "Estimation") characterizing the data connection, 
evaluating a de-jittering delay forthe data connection by predicted parameters (Figure 5,6: "Estimation") taking 
55 into account the at least one provided value and the at least one gathered value, 

delaying and converting the data packets following the evaluated de-jittering delay (Figure 3, 4; Figure 5: 
"Estimation", "Stream", "Receive"). 
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4. A computer program product including software code portions for performing steps of Claim 1 for a terminal 
(Figure 5). 

5. A computer program product including software code portions for performing steps of Claim 1 for an output unit 
5 (Figure 5). 

6. A method according to in Claim 1 characterized by measuring the packet inter-arrival times (Figure 5,6, class 
"Estimation"). 

10 7. A method according to in Claim 1 characterized by calculating the variation of the packet inter-arrival times 
(Figure 5, class "Estimation"). 

8. A method according to in Claim 1 characterized by using a network description and routing information for pre- 
dicting said parameters. 

15 

9. A method according to in Claim 1 characterized by performing an initialization based of measurements of at least 
one value characterizing the data connection gathered by the first transmitted packets. 

10. A method according to in Claim 1 characterized by performing an initialization based of measurements of at least 
20 one value characterizing the data connection gathered by previous transmissions. 

11. A method according to in Claim 1 characterized by performing an initialization based of measurements of at least 
one value characterizing the data connection gathered by previous connections. 

25 
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Figure 5: PROGRAM 



DECLARATION 



Channel: Input 
Stream: Output 
PriorityQueue: Buffer 



DATA TYPE Channel 

Boolean: End() 
Packet: Fetch() 
END DATA TYPE Channel 



... returns true if the stream ends 
... gets the next arrived packet 



DATA TYPE Stream 

Append(Element) ... adds a data element to a stream 



Element: Read() 
END DATA TYPE Stream 

DATA TYPE PriorityQueue 

Add(Element) 
Element:Get() 
Boolean:lsEmpty() 
lnteger:Size() 
END DATA TYPE PriorityQueue 

IMPLEMENTATION 

PROCESS Receive 

WHILE (NOT lnputend()) DO 
packet = Input.Fetch() 
Estimation. Measure(packet) 
Buffer.Add(packet) 
END WHILE 
END PROCESS Receive 



gets the next data element 



... add a packet to this priority queue 
... returns and deletes the least element of this queue 
... returns true if the queue is empty 
... returns the size of a queue 



... grabs the input channel 

... fetch each packet 
measure network performance 
... queue the packet 



streams the data continuously 

... wait for filled buffer 
... empty the buffer 



PROCESS Stream 

WHILE (NOT (Input. End() AND Buffer.isEmptyQ)) DO 
Estimation. Predict(BufferSize, DelayTime); 
WHILE(Buffer.SizeO<Sa/ferS/ze) WAIT END WHILE 
WHILE (NOT Buffer, is Empty ()) DO 
Output.Append(Buffer.Get()) 
DELAY (DefayTime) 
END WHILE 
END WHILE 
END PROCESS Stream 

CLASS Estimation 

Real: mean delay, delay variation, ... 
METHOD Measure (packet) 

update mean delay, delay variation . 
END METHOD 



METHOD Predict(buffer size, delay time) 

buffer size = Characteristic function for buffer size (mean delay ) 

delay time = constant 0 
END METHOD 
END CLASS Estimation 
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Figure 6: 



CLASS Estimation 
Real: T 

Real: constant sr; 
Real: tr; 

Integer: R; ... initialized by the number of packets to be streamed 

Integer: n; _ initialized by 0 

. . . delay time t of the arrived packet 
. . . updated mean delay time T 
... update number of received packets 
updated number of packets to be streamed R 



METHOD Measure(t) 

T=(n*T + t)/(n+1) 
/? = n + 1; 

END METHOD 



METHOD Predict(B, 1/sr) . . . estimated buffer size B 

... constant time for streaming one packet sr 
tr = 1/T ...the mean transmission rate tr 

B-sr/tr*R-R ...the predicted buffer size B 

END METHOD 
END CLASS Estimation 
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